Turning the Web into an Effective Knowledge Repository

The weight of dynamically generated content versus static content has progressed enormously. Preserving accessibility to this type of content raises new issues. However, there are no large-scale mechanisms to enforce referential integrity in the WWW. We propose a system, comprised of a distributed web-proxy and cache architecture, to access and automatically manage web content, static and dynamically generated. It is combined with an implementation of a cyclic distributed garbage collection algorithm. It is scalable, correctly handles dynamic content, enforces referential integrity on the web, and is complete with regard to minimizing storage